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This invention relates to a method and apparatus 
for processing image data. For example, this Inven- 
tion relates to a method and an apparatus for editing 
two sets of image data into a composite image data 
set. 

In the field of computer graphics, it is known to 
edit two sets of image data into a composite image 
data set As will be explained later, a prior art method 
and a prior art apparatus for editing image data have 
some problems. 

As shown in Fig. 1 , a prior art apparatus for pro- 
cessing image data includes an image input device 
601, an image data Input terminal 602, and an image 
data processing device 603. 

The image input device 601 includes, for 
example, a scanner. The image input device 601 out- 
puts image data to the image data processing device 
603. Image data can be fed from an external device 
(not shown) to the image data processing device 603 
via the image data Input temilnai 602. The image data 
processing device 603 includes a computer having a 
CPU, a RAM, and a storage device for storing a pro- 
gram. The image data processing device 603 oper- 
ates in accordance with this program. The image data 
processing device 603 stores the input image data 
into an image data file device 605 including, for 
example, a magnetic disk. 

A console 604 is connected to the image data pro- 
cessing device 603. The console 604 includes a dis- 
play or a monitor, and a manual operating device such 
as a keytx>ard and a mouse. During image data pro- 
cessing, the ffnage data processing device 603 reads 
out image data from the image data file device 605 
and then transfers the image data to the monitor in the 
console 604 so that the image data will be visualized 
on the monitor. While the operator observes the repro- 
duced image on the monitor, the operator actuates the 
operating device in the console 604 to input instruc- 
tions of processing the reproduced image, for 
example, instructions of revising, changing, and edit- 
ing the reproduced image. The input instructions are 
transmitted from the console 604 to the image data 
processing device 603. The Image data processing 
device 603 processes the image data in compliance 
with the input instructions by referring to an image 
data processing segment of the program. The resul- 
tant image data are fed from the Image data proces- 
sing device 603 to the monitor in the console 604 so 
that the resultant image data will be visualized on the 
monitor. The resultant image data are output from the 
image data processing device 603 to an image output 
device 606. The resultant image data can be output 
from the image data processing device 603 to an 
external device (not shown) via an image data output 
terminal 607. 

Fig. 2 shows an example of conditions of indi- 
cated infomnation on the monitor in the console 604. 
As shown in Fig. 2. this example includes different 



images "A", "B", and "C which respectively occupy 
regions within an editing area [a, b], that is, an editing 
rectangular area defined by opposing vertex points 
"a" and "b". A description will be given of editing the 
5 images "A". "B", and "C into a composite image which 
fills the editing area [a, b]. Firstly, data having values 
equal to "0" are generated as initial data representing 
an initial image filling the editing area [a, b]. Secondly, 
the initial image data are processed Into second 
10 image data by adding data of the image "A" to the inn 
tial image data. Then, the second image data are slmi- 
lariy processed into third image data In response to 
data of the image "B". Similariy, the third image data 
are processed into final image data in response to 
15 data of the image "C". The final Image data represent 
an image which occupies the editing area [a, b] and 
which agrees with a resultant of editing the images 
"A-, -B", and -C^ 

The atjove-mentioned prior art method and 
20 apparatus have the following problems. In the case of 
editing two or more images into a composite image, it 
is necessary to newly prepare an edited image data 
file in the image data file device 605. As shown in Fig. 
2, the resultant image has a hatched area which is 
25 represented by meaningless data "0". The meaning- 
less data "0" occupies a part of an Image memory 
within the image data processing device 603, so that 
the part of the image memory is wasted. 

It is an aim of this invention to provide an 
30 improved method of processing image data. 

It is another aim of this invention to provide an 
improved apparatus for processing image data. 

A first aspect of this invention provides a method 
of processing image data representative of at least 
35 two source images having respective overiap portions 
which overiap each other in Indicated positions, the 
method comprising the steps of storing input source 
images as digital data; editing the digital data into 
edited image data; and outputting the edited Image 
40 data; characterised in that the step of editing the digi- 
tal data comprises: 

changing data in the overiap portion of a first 
image of the source images so as to represent txjth 
display infomnation of the overiap portion of the first 
45 image and display infonmation of the overiap portion 
of a second Image of the source images. 

A second aspect of this invention provides an 
apparatus for processing image data representative 
of first and second images having respective overiap 
so portions which overiap each other In indicated posi- 
tions, the apparatus comprising: 

means for changing data of the overiap portion 
of the first image so as to represent both display Infor- 
mation of the overiap portion of the first image and dls- 
55 play infonnation of the overiap portion of the second 
image, and for modifying data of the first image into 
data representative of a third image; 

processing means for perfonming a predeter- 
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mined process on the data of the overiap portion of the 
second image to a predetermined process, and for 
modifying the data of the second image into data rep- 
resentative of a fourth image; and 

means foroutputting the data of the third image 
and the data of the fourth image. 

The present invention wilt be further described 
hereinafter with reference to the following description 
of an exemplary embodiment and the accompanying 
drawings, in which: 

Fig. 1 is a block diagram of a prior art apparatus 
for processing image data. 

Fig, 2 is a diagram showing an example of an indi- 
cated composite image in the prior art apparatus of 
Fig. 1. 

Fig, 3 is a block diagram of an apparatus for pro- 
cessing image data according to an embodiment of 
this invention. 

Fig. 4 is a diagram showing an example of an indi- 
cated composite image in the apparatus of Fig. 3. 

Fig. 5 is a diagram showing source images sub- 
jected to an editing process. 

Fig. 6 is a diagram showing an example of an indi- 
cated composite image which occurs after an editing 
process is completed in the apparatus of Fig. 3. 

Fig. 7 is a diagram showing an example of an indi- 
cated composite image which occurs before an edit- 
ing process is completed in the apparatus of Fig. 3. 

Fig. 8 is a flowchart of a part of a program operat- 
ing the image data processing device in the apparatus 
of Fig. 3. 

Fig. 9 is a diagram showing image and conditions 
of data stored into the output buffer in the apparatus 
of Fig. 3. 

With reference to Fig. 3, an image data proces- 
sing apparatus of this invention includes an image 
input device 101, an image data input terminal 102, 
and an image data processing device 103. 

The image input device 101 includes, for 
example, a scanner. The image input device 101 out- 
puts image data to the image data processing device 
103. Image data can be fed from an external device 
(not shown) to the image data processing device 103 
via the image data input terminal 1 02. The image data 
processing device 1 03 includes a computer having a 
CPU, a RAM, and a storage device for storing a pro- 
gram. The image data processing device 103 oper- 
ates in accordance with this program. The image data 
processing device 103 stores the input image data 
into an image data file device 105 including, for 
example, a magnetic disk. 

A console 104 is connected to the image data pro- 
cessing device 103. The console 104 includes a dis- 
play or a monitor, and a manually operating device 
such as a keyboard and a mouse. During image data 
processing, the Image data processing device 103 
reads out Image data from the image data file device 
1 05 and then transfers the image data to the monitor 



In the console 104 so that the image data will be 
visualized on the monitor. While the operator obser- 
ves the reproduced image on the monitor, the 
operator actuates the operating device in the console 

5 1 04 to input instructions of processing the reproduced 
image, for example, instructions of revising, chang- 
ing, and editing the reproduced image. The input 
Instructions are transmitted from the console 104 to 
the image data processing device 103. The image 

10 data processing device 1 03 processes the image data 
in compliance with the input instructions by referring 
to an image data processing segment of the program. 
The resultant image data are fed from the Image data 
processing device 103 to the monitor in the console 

15 1 04 so that the resultant image data will be visualized 
on the monitor. The resultant image data are output 
from the image data processing device 103 to an 
image output device 106. The resultant image data 
can be output from the image data processing device 

20 103 to an external device (not shown) via an image 
data output terminal 107. 

The image data processing device 103 includes 
an image data memory 103 A and an image data out- 
put buffer (an image data output buffer memory) 

25 1 03B. In general, the image data memory 103A is 
used to store data subjected to processing and 
visualized on the monitor in the console 104. In addi- 
tion, the output buffer 103B is used to store data to be 
outputted. The image memory 103A and the output 

30 buffer 103B will be explained in detail later- 
Fig. 4 shows an example of conditions of a com- 
posite image which is represented by data output from 
the image data processing device 1 03 and obtained 
by an editing process. In Fig. 4, an area [a, b] defined 

35 by the broken lines, that is, a rectangular area defined 
by opposing vertex points "a" and "b", agrees with an 
area of the composite image which results from the 
editing process. As shown in Fig. 4, the composite 
image has sub images "A", "8**, and "C" which are 

40 generated from original images (source images) 
through processing, layout or synthesis. Portions of 
the composite image which extend outside the sub 
images "A", "B", and "C are represented by data 
which are not stored in the image memory 103A and 

45 which are generated in the image data buffer 103B. 
For example, the data of the portions of the composite 
image outside the sub images "A", "B". and "C are 
generated by clearing the output buffer 103B. 

As shown in Fig. 4, the images "B" and "C par- 

50 tially overiap each other, and the images "B* and "C" 
occupy a higher place and a lower place respectively. 
As shown in Fig. 5. the overiap portion of the higher- 
place image "B" is represented by data which result 
from the editing process, while the overiap portion of 

55 the lower- place image "C" is represented by data of 
"0". In the image data file device 105, the data repre- 
senting the image "B" and the data representing the 
image "C" are managed independently of and sepa- 
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rately from each other. 

Fig. 6 shows an example of the finally-obtained 
composite image which Is indicated on the monitor in 
the console 104 or an external monitor under condi- 
tions where the data of the composite image are trans- 
fenred in a sequence corresponding to a direction from 
the lowest Image place to the highest image place. In 
this case, since the overiap portion of the image "B" 
is represented by the data which result from the edit- 
ing process, both the original information in the over- 
lap portion of the image "B" and the original 
infonmation in the overiap portion of the image "C" are 
accurately indicated. 

Fig. 7 shows an example of an intenmediately-ob- 
tained image which is indicated on the monitor in the 
console 104 or an external monitor under conditions 
where the editing process has not yet been completed 
and where the data of the image are transferred in a 
sequence corresponding to a direction from the low- 
est image place to the highest image place. In this 
case, the original information in the overlap portion of 
the image "B" is indicated, but the original information 
in the overiap portion of the Image "C is not indicated. 
The non-indication of one of the original infonmation 
represents that the editing process has not yet been 
completed. Thus, a decision as to whether or not the 
editing process has been completed can be perfor- 
med by referring to the conditions of the indication of 
the overiap portions of the images. 

Fig, 8 is a flowchart of the editing segment of the 
program controlling the image data processing device 
103. As shown in Fig. 8, a first step 201 of the editing 
segment of the program prepares a management file 
in accordance with operator's instruction. The man- 
agement file is designed so as to manage a plurality 
of sub images (source images or original Images) to 
be edited. The management file is provided in the 
image data file device 105. A step 202 following the 
step 201 registers the names of the sub images and 
the indicated positions of the sub images In an output 
composite Image with the management file. A step 
203 following the step 202 controls the monitor in the 
console 104 so that a composite image will be gener- 
ated on the nfKinltor in response to the registered Infor- 
mation of the sub images and the data of the sub 
images. In the generation of the composite image, the 
sub images are indicated on the monitor in a sequ- 
ence according to an order of the indicated positions 
of the sub images in an overwriting manner. When the 
composite image extends beyond the edges of the 
screen of the nxinitor, the composite Image Is contrac- 
ted so that the whole of the composite Image can be 
indicated on the monitor. At this stage, when two sub 
images overiap each other in the composite image, 
the overiap portion of one of the sub images is mas- 
ked by the overiap portion of the other sub image as 
shown in Fig. 7. After the step 203, the program adv- 
ances to a step 204. 



The step 204 selects one or more of the sub 
images in accondance with operator's instruction. For 
example, the selected sub images agree with sub 
Images overiapping each other, and the selected sub 
5 image agrees with a sub image to be edited. The step 
204 transfers the information and data of the selected 
sub Images to the image memory 103A. A step 205 
following the step 204 controls the monitor in the con- 
sole 104 so that the selected sub images will be indi- 
10 cated on the monitor. 

A step 206 following the step 205 edits the over- 
lap portions of the selected sub images In compliance 
with operator's instruction. Specifically, as shown in 
Fig. 5, the data of the overiap portion of the higher- 
15 place image are changed so as to represent both the 
display information of the overiap portion of the hi- 
gher-place image and the display information of the 
overiap portion of the lower-place image, while the 
data of the overiap portion of the lower-place image 
20 are cleared to "0". A step 207 following the step 206 
transfers the infonnation and data of the resultant 
edited sub Images from the image memory 103A to 
the image file in the image data file device 105 so that 
the infonmation and data of the resultant edited sub 
25 images will replace the infonnation and data of the 
corresponding previous sub images in the image file. 

A step 208 following the step 207 decides 
whether or not the editing process is completed, that 
is, whether or not an image to be edited remains. 
30 When the editing process is completed, the program 
advances from the step 208 to a step 209. When the 
editing process Is not completed, the program returns 
from the step 208 to the step 204. As a result, the 
steps 204-208 are reiterated until the editing process 
35 is completed. 

The step 209 controls the monitor in the console 
104 so that the resultant composite image will be 
reproduced on the monitor in response to the infor- 
mation and data of the edited sub images. In the 
40 reproduction of the composite image, the sub Images 
are Indicated on the monitor In a sequence according 
to Indicated position. A step 210 following the step 
209 decides whether operator's Instruction repre- 
sents acceptance or rejection of the indicated compo- 
45 site image. When the composite image is rejected, the 
program returns from the step 210 to the step 204. 
When the composite image is accepted, the editing 
segment of the program ends. 

The data of the finally-obtained composite image 
so are outputted as follows. In the case where the data 
of the composite image which correspond to a scan- 
ning line "a" of Fig. 9 are outputted firom the image 
data processing device 103, It Is necessary to output 
both the data of the sub Image "A" and the data of the 
55 sub image "8". In this case, the data of the lower-place 
image "B" are transferred to the portion of the output 
buffer 1 038 which extends between positions b1 and 
b2, and then the data of the higher-place image "A" 
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are transferred to the portion of the output buffer 1 03B 
which extends between positions a1 and a2 as shown 
in Fig. 9. Thereafter, the image data are transfenred 
from the output buffer 1 03B to the innage output device 
106. 

In the case where the data of the composite 
image which correspond to a scanning line "b" of Fig. 
9 are outputted from the image data processing 
device 1 03, it is necessary to output both the data of 
the image "B" and the data of the Image "C*. In this 
case, the data of the lower-place image "C" are trans- 
ferred to the portion of the output buffer 103B which 
extends between positions c1 and c2, and then the 
data of the higher-place image "B" are transferred to 
the portion of the output buffer 103B which extends 
between positions b1 and b2 as shown in Fig. 9. 
Although the data of the overlap portion of the image 
"B" are written over the data of the overlap portion of 
the image "C" in the output buffer 1 038, the data in the 
output buffer 103B represent a correct composite 
image since the data of the overlap portion of the 
image "B" are previously changed so as to represent 
both the display information of the overlap portion of 
the image "B* and the display information of the over- 
lap portion of the image "C". 

Fig. 10 is a flowchart of the data outputting seg- 
ment of the program controlling the image data pro- 
cessing device 103. As shown in Fig. 10, a first step 
301 of the data outputting segment of the program 
designates a management file, which is prepared In 
the editing process of Fig. 8, in response to operator's 
instruction. A step 302 following the step 301 numbers 
respective sub images in the management file by "i" 
in an order according to indicated position. 

A step 303 following the step 302 prepares an 
output line management table in response to the infor- 
mation of the indicated positions of the sub images. 
The output line management table contains an output 
starting line number Ysi, an output ending line number 
Yei, an output starting horizontal (X) position Xsi, and 
an output ending horizontal (X) position Xei for each 
sub image denoted by a number "i". As will be exp- 
lained later, an image to be output and its data are 
determined by referring to the output line manage- 
ment table. A step 304 following the step 303 prep- 
ares the image data output buffer 103B by, for 
example, using a portion of the RAM within the image 
data processing device 103. A step 305 following the 
step 304 initializes an output image line number "L". 
After the step 305, the program advances to a step 
306. 

The step 306 refers to the output line manage- 
ment table, and thereby selects a number or numbers 
"i" denoting a sub image or sub images to be output 
at the current output line "L". The step 306 generates 
a set{i}L of the selected number or numbers "i". A step 
307 following the step 306 compares the set {t}L with 
the set {i}L-1 which was generated with respect to the 



preceding output line "L-1". This comparison is to 
detect whether the set {i}L has changed from the pre- 
ceding set {i}L-1 or remains unchanged, that Is, 
whether or not there occur a new sub image to be out- 

5 putted at the current line "L" and the sub image which 
should cease from being output at the current output 
line "L". When the set {i}L has changed finorn the set 
{i}L-1, the program advances from the step 307 to a 
step 308. When the set {i}L is equal to the set {i}L-1. 

10 the program advances from the step 307 to a step 
310. The step 308 sets an image line number Y1 for 
the new sub image detected by the preceding step 
307. The step 308 initializes the image line number Yi 
to 1 . The image line number Yi is independently set 

15 for each of the respective sub images. A step 309 fol- 
lowing the step 308 clears the output buffer 1038. 
After the step 309, the program advances to the step 
310. 

The step 310 transfers the line data of the image 

20 line number YI of each sub image to the area of the 
output buffer 103B which extends between positions 
corresponding to the output starting horizontal posi- 
tion Xsi and the output ending horizontal position Xei, 
The line data of the sub images are transferred in a 

25 sequence according to vertical indicated position. The 
step 310 increments the image line number YI which 
corresponds to the image number '*i'*, the transfer of 
which is completed. A step 31 1 following the step 31 0 i 
decides whether or not the transfer of the data of all 

30 the su b i mag es is com pt eted . Whe n th e tra nsf e r of the 
data of ail the sub images is not completed, the pro- 
gram returns from the step 31 1 to the step 310 so that 
the step 310 will be reiterated. When the transfer of 
the data of all the sub images is completed, the pro- 

35 gram advances from the step 31 1 to a step 312. 

The step 312 transfers the data from the output 
buffer 103B to the Image output device 106. A step 
313 following the step 312 Increments the output line 
"L" by executing the statement "L=L+1". A step 314 

40 following the step 313 decides whether or not the out- 
put line "L" agrees with a predetermined final line. 
When the output line "L" disagrees with the final line, 
the program returns from the step 31 4 to the step 306. 
When the output line "L" agrees with the final line, the 

45 data outputting segment of the program ends. 



Claltns 

50 1 . A method of processing image data representa- 
tive of at least two source images having respec- 
tive overiap portions which overiap each other in 
indicated positions, the method comprising the 
steps of storing input source images as digital 

55 data; editing the digital data into edited image 

data; and outputting the edited image data; 
characterised in that the step of editing the digital 
data comprises: 



5 



EP0 459 711 A2 



changing data in the overlap portion of a 
first image of the source images so as to repre- 
sent both display information of the overlap por- 
tion of the first image and display infonmatlon of 
the overlap portion of a second image of the 5 
source images. 

2. A method according to claim 1 , further comprising 
the step of setting data of the overlap portion of 

the second image to a null value. 10 

3. A method according to daim 1 or 2, further com- 
prising the step of selecting two of the source 
images as the first image and the second image 

in respKDnse to the indicated positions thereof. 15 

4. An apparatus for processing image data rep- 
resentative of first and second images having res- 
pective overlap portions which overlap each other 

in indicated positions, the apparatus comprising: 20 

means for changing data of the overlap 
portion of the first image so as to represent txjth 
display information of the overiap portion of the 
first image and display infonnation of the overiap 
portion of the second image, and, for modifying 25 
data of the first image into data representative of 
a third image; 

processing means for perfonming a pre- 
detenmined process on the data of the overiap 
portion of the second image, and for modifying 30 
the data of the second image into data represen- 
tative of a fourth image; and 

means for outputting the data of the third 
image and the data of the fourth image. 

5. An apparatus according to claim 4, wherein the 
processing means comprises means for setting 
the data of the overiap portion of the second 
image to a null value. 



35 
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6. An apparatus according to daim 4 or 5. wherein 
the outputting means comprises an output buffer, 
first writing means for writing the data of the fourth 
image into the output buffer, second writing 
means for, after the first writing means writes the 4s 
data of the fourth image into the output buffer, 
writing the data of the third image into the output 
buffer and writing data of an overiap portion of the 
third image over data of an overiap portion of the 
fourth image, and means for outputting the data so 
of the fourth image and the data of the third Image 
from the output buffer 
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